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ABSTRACT 


For  random  walks  s^,  n*l,2,...  whose  distribution  can  be  imbedded 
in  an  exponential  family,  a  method  is  described  for  determining  the 
asymptotic  behavior  as  m  **  00  of 

P{s  >  m  c(n/m)  for  some  n<m|s  *  m  y  }  (y  <c(I)). 
n  moo 

Applications  are  given  to  the  distribution  of  the  Smirnov  statistic 
and  to  modified  repeated  significance  tests. 


AMS  1970  Subject  Classification.  Primary  60F05,  60JI5.  Secondary  62LIO. 

Key  Words  and  Phrases.  First  passage  distribution,  stopping  rule,  large 
deviation,  sequential  test. 
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Large  Deviations  for  Boundary  Crossing  Probabilities 
I .  Introduction* 

Let  XpX^****  be  independent,  identically  distributed  random 
variables  and  *  Given  a  positive  function  c(t), 

t  0,  and  m  >  0  ,  define  the  first  passage  time 

(1)  T  -  T  *  inf{n:  a  >  m  c(n/m)} 

m  n 

The  purpose  of  this  paper  is  to  describe  a  method  for  studying  the 
asymptotic  behavior  of  the  conditional  probabilities 

(2)  P{T  <  m  |  sffl  -  m  Uo}  <Vo  <  c(l))  , 

which  under  conventional  assumptions  on  the  function  c(*)  and  the 
distribution  of  x^  converge  to  0  exponentially  fast  as  m  ®  . 

A  number  of  methods  have  been  developed  for  approximating  the 
unconditional  probabilities  P{T  <_  m)  under  various  conditions 
on  c(*)  and  the  distribution  of  ,  cf.  Borovkov  (1962,  1964), 
Daniels  (1974),  Ferebee  (1981),  Jennen  and  Lerche  (1981),  Lai  and 
Siegmund  (1977),  Lalley  (1980),  Siegmund  (1978),  and  Woodroofe 
(1976b,  1978).  Some  of  these  methods  seem  adaptable  to  an  invest¬ 

igation  of  the  conditional  probabilities  (2).  In  principle,  knowledge 
about  the  conditional  probabilities  (2)  can  be  translated  into  know¬ 
ledge  about  P{T  _<  m)  by  integrating  out  uo  ,  although  a  rigorous 
justification  of  this  approach  leads  to  questions  of  uniformity 
in  \\Q  which  may  involve  additional  technical  difficulties. 

This  paper  gives  a  new  technique  for  studying  (2).  Although  the 

problems  of  approximating  P{T  <  m)  and  P{T  <  m  I  s  *  m  y  }  differ 

—  mo 

in  important  respects,  there  seems  to  be  enough  similarity  to  warrant 
an  informal  comparison  of  the  method  introduced  here  with  the  techniques 
of  the  papers  mentioned  above.  The  method  of  this  paper  permits  a 


fairly  broad  class  of  functions  c(*)  and  has  the  aesthetically 
pleasing  feature  of  making  a  minimal  distinction  between  random  walk 
and  Brownian  motion.  In  contrast,  the  methods  of  Borovkov  and  Woodroofe 
are  directly  applicable  only  to  random  walk;  those  of  Daniels,  of 
Ferebee,  and  of  Jennen  and  Lerche  apply  to  an  extremely  broad  class 
of  functions  c(#)  but  seem  limited  to  the  intrinsically  simpler 
case  of  Brownian  motion.  The  Lai-Siegmund  method  is  general  with 
regard  to  processes  but  limited  with  regard  to  functions  c(*)  . 

Like  the  methods  of  Woodroofe,  Lai-Siegmund ,  and  Lalley,  the  method 
described  below  seems  to  adapt  readily  to  certain  multidimensional 
problems,  although  no  results  in  this  direction  have  been  developed 
in  detail.  For  linear  c(0  it  is  particularly  simple.  In  a  very 
special  case  it  was  used  by  Siegmund  and  Yuh  (1981)  to  give  an  easy 
derivation  of  Anderson* s  (1960)  results  for  Brownian  motion.  In  addi¬ 
tion  to  these  technical  aspects,  the  method  provides  a  different 
perspective  towards  boundary  crossing  problems,  which  will  become 
apparent  during  the  development  of  the  paper. 

A  glance  at  the  literature  mentioned  above  shows  that  systematic 
theory  for  problems  of  this  sort  is  exceedingly  technical.  Hence  the 
following  discussion  is  restricted  to  two  examples  which  are  important 
in  applications  and  which  seem  to  indicate  the  scope  of  the  method.  The 
case  of  linear  c(*)  receives  a  reasonably  general  and  rigorous  treat¬ 
ment  in  Section  2.  As  an  application  one  obtains  the  large  deviation 
probabilities  of  the  Smirnov  statistic,  which  are  shown  numerically 
to  provide  excellent  approximations  even  for  **8111311  deviations**. 

A  simple  but  illuminating  non-linear  example  is  provided  by  normal 

j  /2 

random  walk  and  the  stopping  boundary  c(t)  -  St  .  The  stopping  rule 
T  is  closely  related  to  Armitage’s  (1975)  repeated  significance  test. 

This  example  is  discussed  in  Section  3,  and  the  results  are  applied  to 
give  an  asymptotic  approximation  to  the  error  probabilities  of  a 
modification  of  this  test  suggested  by  Peto  et .al .  (1976)  and  Siegmund (1978) • 


2.  The  linear  case 


Assume  that  the  distribution  F  of  Xj  can  be  imbedded  in  an 
exponential  family,  i.e.  for  all  0  in  some  neighborhood  of  0 
exp[^(0)]  /  exp(0x)F(dx)  is  finite,  so 

exp[0x  -  ij/(0)  ]F (dx)  defines  a  family  of  probability  distributions 
indexed  by  0  .  It  is  well  known  (and  easy  to  see)  that  the  mean  and 
variance  of  these  distributions  are  respectively  ^'(0)  end  ♦,I(0)^O. 

Hence  y  -  i£f(0)  is  a  one  to  one  function  of  0  (unless  F  is  degenerate). 
It  will  be  convenient  to  regard  this  family  of  distributions  as  indexed 
by  y  and  write  F^(dx)  *  exp[ 0x  -  iK0) ]F(dx) .  To  emphasize  that  0  is 
a  function  of  y  ,  the  notation  0(y)  is  occasionally  used.  Let  P^ 
denote  the  probability  according  to  which  Xj ,  X2»*«*  are  independent 
with  e  dx}  ■  Fp(dx)  (k  *  1,2,  ...  ). 

An  additional  technical  assumption  is  required  to  insure  that 
conditional  probabilities  are  well  defined  and  that  local  limit  theorems 
apply.  This  assumption  can  be  either  that  F  is  arithmetic  or  that  it 
has  a  well-behaved  density.  Only  the  latter  case  is  explicitly  considered 
here.  An  unnecessarily  strong  but  convenient  assumption  is  that  for  all 
y  there  exists  an  n  such  that 

«  n 

(3)  /  |  exp(iXXj) |  dX  <  ■>  . 

■  00 

This  implies  that  the  distribution  of  s^  has  a  bounded  density 

f  which  obeys  a  standard  local  central  limit  theorem  (Feller,  1966, 
y  ,n 

p.489) .  To  avoid  some  uninteresting  calculations  it  is  also  convenient 
to  assume  that  the  P^  distribution  of  x^  has  a  bounded  density. 

Let  F  -  B(xlf...,  x  )  and  let  P  denote  the  restriction 
n  i  n  y»n 

of  P  to  F  ,  so 


y,n 


(4) 


dP  / dP~ 
U,n  u,n 


where  0  ■  0  (y) . 


P^m) (A) 


-  exp{(0-0)sn-n[iK0)  -  <l>(9)  ]} 
For  m* 1 , 2 , . . .  and  A  €  F  let 

DK 

“  pu(a|»  ■  m€)  , 

y  m 


» 


and  for  n  <  m  let  P?*"*  denote  the  restriction  of  P^  to  F  . 

5»n  £  n 

By  sufficiency  of  s^  ,  P^  does  not  depend  on  y  . 

The  main  result  of  this  section  is 


Theorem  1 .  Let  C  >  0  and  yQ  6  (-»,?)  n  {y}  .  Define 

t  •  infjn:  8  >  me}  and  x  *  inf{n:  s  >  o}.  Assume  that  there 
n  +  n 

exist  y^  <  0  <  (necessarily  unique)  such  that 

(5)  *(0(y2>)  -  *(00*,)) 

and 

(6)  I  -  u^C  +  |w2r*  (C-  y0)  . 

Let  0£  -  0(yi)  and  *"(6^  (i-0,1,2). 

Then  as  m  -*■  ® 


(7) 


~  K(c,yo)exp{-m[(0J-02)i;  +  (02-0o)yo  -  *(02)  +  <H0O)  ] } 


where 

(8)  K(C,y0) 


"oh I7  fu,<y  ~>  (  t  °|hl3t  |  ‘  2 


Remarks, 

(i)  It  is  usually  routine  to  verify  the  existence  of  y^  and  y^ 
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_ _ »#  . 


r 


and  to  compute  them.  For  example,  if  iKO)  and  ^f(0)  both  diverge 
(continuously)  to  +00  as  6  approaches  the  endpoints  of  its  interval 
of  definition,  a  simple  picture  demonstrates  the  existence  of  y 
and  satisfying  (5)  and  (6)  . 

(ii)  The  quantities  P^^***00}  an<*  Ey  T+  01118 1  usually  be  computed 

numerically.  SeeWoodroofe  (1979)  for  a  Fourier  inversion  technique  to 

obtain  the  ratio  P  {t  »®}/E  x  and  for  several  examples. 
w2  V\ 

(iii)  It  is  not  difficult  to  generalize  the  Theorem  to  allow  £  and 
Hq  to  depend  on  m  and  converge  at  suitable  rates.  The  details  of 
this  generalization  have  been  omitted,  although  the  example  of  the 
Smirnov  statistic  given  below  uses  such  a  result. 


Examples . 

(a)  Suppose  that  the  distribution  of  x^  is  normal  with  mean  y 
and  variance  1.  By  symmetry  Uj  ■  -  \i^  ,  and  it  is  easy  to  see  that 
Uj  «  2s  -  Uq  •  The  proof  below  shows  that  this  value  of  y^  is 
tantamount  to  the  standard  reflection  principle.  Easy  algebra  and 
known  random  walk  theory  (Feller,  1966,  chapter  XVIII  )  show  that 
the  right  hand  side  of  (7)  becomes 

.  _  i 

[2(2?-u0)2]  exp {-2  l  n  1  ® [ -n2  (2c— ViQ)  ] }  exp{-2  in  e(c-yQ)}  . 

The  final  exponential  factor  in  this  expression  is  the  well  known, 
exact  probability  for  the  corresponding  problem  with  Brownian  motion 
instead  of  random  walk.  The  first  two  factors  account  for  excess  over 
the  boundary. 

(b)  If  denotes  the  uniform  empirical  distribution  function, 

the  well  known  representation  of  the  uniform  order  statistics  in 
terms  of  sums  of  independent  exponential  random  variables  (e.g. 
Breiman,  1968,  p.285)  shows  that 


p{  sup  (x  -  F  (x) )  >  C }  *  p{  max  (W.-j)  >  n?  -  1  |  W  (n+1)  -  -  l}  , 

o<x<l  n  l<j<n  J  “  n+l 

vhere  W.  -  yj  +  ...+  and  yjty2».*«  are  independent  standard  ex¬ 
ponential.  This  is  almost  in  the  form  required  by  Theorem  1  with  m»n+l 
and  s^  ■  -  k,  except  that  m£  has  been  replaced  by  (m-l)£-  1 

and  i*  »  -  I/m  depends  on  m  *  Minor  changes  in  the  calculation  which 
•  o 

yields  Theorem  1  give  as  n  » 


(9)  P{  sup  (x-F  (x))  >  c} 
o<x<  1  n 


exp{-n[ (0j  -  02)C  +  02  +  log ( 1  -  02)]} 

cCi02r,(i-02)[i  +  (|02|0,1)3(j-0,)(i-02)~1]}i/2 


vhere  <  °  <  ©1  sat*-sfy  0l“02  “  0 -02)  / O“0 j )]  and 

8 j  ^  +  | ©2 1  *  *  C  '  *  Bahadur  (1971,  p.15)  has  determined  the  exponent 

on  the  right  hand  side  of  (9) .  It  is  not  immediately  obvious  that  his 
answer  is  the  same  as  that  given  here,  but  a  simple  calculation  shows 
that  the  two  agree. 

The  exact  distribution  of  sup (x-F  (x))  is  known  (Birnbaum  and 

x  n 

Tingey,  1951),  although  it  is  inconvenient  for  numerical  calculation 
when  n  is  large.  For  small  values  of  n 

Table  1  compares  some  exact  probabilities  with  approximations  obtained 
from  (9).  The  classical  Smirnov  approximation,  exp(-2nc  ),  is  also 
included.  One  can  easily  see  that  (9)  provides  a  very  good  approxima¬ 
tion  even  for  small  5  ,  for  which  the  probability  in  (9)  is  not  close 
to  0  • 
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Table  !. 


Exact  and  Approximate  Tail  Probabilities  for  the  Smirnov  Statistic. 

In  each  cell  the  first  entry  is  the  exact  probability.  The  second 
and  third  are  approximations  given  by  (9)  and  by  e  respectively. 


04395 

.2555 

•  5652 

950 

.500 

.050 

957 

.510 

.049 

985 

.593 

.078 

03730 

.1804 

.4796 

950 

.500 

.010 

952 

.499 

.010 

975 

.557 

.016 

Proof  of  Theorem  1 . 

To  motivate  the  method  of  proof  it  is  helpful  to  consider  first 
the  case  of  normal  random  walk,  i.e.  f^  n00  *  n  <p[(x-np)/n  ]  , 

where  <p(x)  -  (2tt)  exp(-x^/2).  Recall  that  denotes  the 

P  #n 

restriction  of  P^  to  the  o-algebra  F  »  8(x,,...,x  )  (n  <  m) . 

\i  n  I  n  — 

Let  p  <  C  and  let  P,  ■  2C~M  be  the  Reflection**  of  p  about  t  . 
o  i  o  o 

By  direct  calculation  one  sees  that  for  n  <  m 

dpJm)>n/dP^n  -  exp{-  2mc(?-uo)  -  2  (c  -  KQ)  (sn  -  mO /(I  -  n/m)  }  , 


and  hence 


(10)  (  T<m)  -  exp{-2mf;U-P  )}  /  exp{-2U-p  )  (s  -mC) /(1-x/m)  }dP^  . 

Wo  °  {  t<dj)  °  T  U\ 

(Observe  that  if  s  were  Brownian  motion,  then  s  *  m£  on  {T<m} 
n  x 

and  P^m^{T<m}  =  1,  which  shows  immediately  that  exp{-2mc(c-p  )} 

° 

is  the  exact  probability  in  this  case.) 

To  avoid  dealing  directly  with  the  conditional  random  walk  governed 

by  ,  one  may  differentiate  with  respect  to  P  (both 

M1  t  Ui  W1 

measures  restricted  to  F  ) .  the  integral  in  (10)  becomes 

^  _  J_ 

(11)  (2x)'^2  /  exp{-2(C-p  )  (s  -m^)/(l-T/m)  }cp[  (s  -p|T)/(m-T)2](l-T/m)  2dP 

{ T<m)  0  T  T  '  P1 


Under  P  ,  x/m  converges  to  c/p.  in  probability,  and  the  joint 
V* .  l 

1  1  /2  . 

limiting  distribution  of  s^  -  £ra  and  (s^-u^t)^  is  known  (e.g. 

Siegmund,  1975).  Hence  evaluating  (11)  asymptotically  becomes  a  matter 

of  straightforward  computation. 


It  should  be  noted  that  although  P 


(tn) 

yi 


plays  a  useful  conceptual 


role,  it  is  superfluous  for  the  rigorous  proof,  because  one  can 


differentiate  P 


(m) 


directly  with  respect  to  P  (both  restricted 


1 


to  F  )  and  by  pass  (10). 


for 


Consider  now  the  general  case,  where  there  is  no  obvious  candidate 

uf  .  Let  f  denote  the  density  function  of  s  .  Recall  that 
In  n 


f  denotes  the  P  density  of  s  and  8.  *  0(y.).  (Hence 
y,n  y  J  n  i  i 


y*n' 


where  0  (y)  *  0.)  For  arbitrary  y^  >0  and  n  <  m 


(12)  ^dP(m)  /dP 

y  ,n  y  ,n 
o  I 


f  _(«P  ”»_)e*p[“®.s  +n  #  (®.)  ]/f  (mw  )  . 
m-n  on  In  I  mo 


8 


By  (4) 


(13)  f  (ni<  )  *  f  (my  )  exp[-m0  u  +  m  i//(0  )] 
mo  p  ,m  o  o  o  o 

o 

and  for  a  yet  to  be  specified 

(U)  VnK'V  “  fV2)0.-nK‘Sn)exp['e2K'Sn)  +  (B’n)*(92)1 

If  v2  <  0  <  u  are  chosen  so  that  (5)  holds,  substitution  of  (13) 
and  (14)  into  (12)  leads  to  the  basic  identity 


(15)  {  t  <  m)  «  exp{~m[(0  -0  )p  +  4>(6  )  “  ♦WJl} 


/  {f  ___ (mu  -s  >exp [- (0  -0)s]/f  (mu  ) }dP 
{T<m}  P2*m  T  °  T  1  2  T  Vm  °  ul 

The  condition  (6)  can  now  be  understood  as  putting  mp^-s^  at 
approximately  the  center  of  the  distribution  f  .  Since 

K  P2,m-T 

P  {x/m  *>  c/b,}  **  1  and  s  s;  Cm  on  (t  <  m}  ,  the  proper  centering 
Pl  1  T 

is  determined  by  p^On-mc/lO  *  m(p  ~c) $  which  is  equivalent  to  (6). 
Z  1  o 

Let  *=  -  Cm  .  Then  (15)  may  be  rewritten 

P  ^x<m}exp{n 


06) 


{m[(O1-02)C  +  (02’eo)vio  *  *<V  ~  ^ (02}  1 1 


•  /  {exp[  -  (0  -0  )R  ]  f  [m(p  -c)"Rm  1/f  (mu  ) }dP 

{ T<m}  1  2  m  y2,m  T  °  m  Vm  °  P1 

By  the  assumption  (3) 


f  (mu  )  ~  (2n  m  a  2  )  2 
p  ,m  o  o 

o 


(m  -*■  ®)  . 
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Since  f 


U2,m-T 


is  bounded  (uniformly  in  m-t)  by  assumption,  Lemmas  1 


and  2  given  below  imply  that  the  integral  in  (16)  may  be  replaced  by 
an  integral  over 


(17)  {t  <  mCUj'o+e),  <  (log  m)2} 


plus  terms  converging  to  0  as  m  +  »  .  (Here  e>o  is  arbitrary  sub¬ 
ject  to  5  V^O+e)  <  1.)  It  follows  from  (3)  and  (6)  that  uniformly 
on  the  event  (17) 

-I  I  -I 

f„  _  [m(v  —  -R  ]  =  o  1  (m— r)  2<p{[u9(T-m;/w  )-R  ]/o  (tn-t)2}  +  o  (m  2  ). 

V»2  *m  x  o  m  Z  2  I  m  2  ' 

Hence  the  integral  in  (16)  has  the  same  limit  as  m  00  as 

I  -II 

(2ir  )2o  0  '  /  exp[-(0-6-)R  ]  (1-t/m)  2<p{  y ,(T-m£/y  )/o  (m—r)2}dP  . 

o  2  '  12m  2  12 

{T<n»tP, 1  (1+e)  ,  Rffl  <  (log  m)2} 

Keeping  in  mind  that  P  {m  +  £y  ^ e  1  and  using  the  known  limiting 

y  1 

1  I  /2 

joint  distribution  of  and  (i-ms/y^/m  (e.g.  Siegmund,  1975), 

one  may  evaluate  the  limit  of  this  integral  as  m  »  and  hence  complete 
the  proof  of  Theorem  1 . 


Lemma  1 .  Let  y,  e  >  o.  Then 

P^{t  >  m  c  y  1  (1+e)}  -  a  (m  2  )  . 

Proof,  Let  n  denote  the  least  integer  greater  than  m^y  *(l+e), 
so  {x  >  mty  *(l+e)}  c:  (s  .  <  nu/(l+e)}  .  Standard  exponential 

I  .  .  n~] 

Chebyshev  inequalities  show  that  the  probability  of  this  event  is 
actually  exponentially  small. 
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>  ;  v. 


I  . 

_  1 

Lemma  2.  Let  y  >  0.  Then  P^{x  <  m,  >  (log  m;  }  -  o(m  ) 

Proof .  The  proof  follows  easily  from 

0  0 
P  {t  <  m,  R  >  (log  m)  }  <  m  P  {x  >  0°8  ®)  } 
y '  m  —  y  I  * 

and  standard  estimates. 


3.  Repeated  significance  tests  -  a  non-linear  example. 


Assume  now  that  xj»x2»"*"  are  independent  N(u,l)  random  vari¬ 
ables  and  that  for  given  b>  0 

1 

T  ■  inf{n:  (s^l  >  b  n2  }. 


For  m  ■  1,2,...  let  T*  *  min(T,m)  .  The  stopping  rule  Tf  defines 

the  repeated  significance  test  of  Arrnitage  (1975):  to  test  H  :  \x  ■  0 

o 

against  H. :  y  4  0  stop  sampling  at  T’  and  reject  H  if  and  only 
I  o 

if  T  m  .  The  power  function  of  this  test  is  P  {t  _<  m},  for  which 
asymptotic  approximations  have  been  given  as  b  -►  «,  m  -*  00  and 
bm~,/2  -  0  (e.g.  Siegmund,  1977,  1978).  Peto  et.al_.  (1976)  and 

Siegmund  (1978)  suggested  a  modification  of  this  test  in  which  there 
is  given  a  number  c,  0  <  c  <  b,  and  one  rejects  Hq  if  either 
•  T  m  or  T  >  m  and  (s^j  >  c  ra^2.  The  power  function  of  the  modi¬ 
fies  test  is 

l 

Pp{T  1  ®}  +  Pp{T  51  «»  l*J  >  C  m2  } 

(18)  1  1 

*  Py{lsJ  >  c  ®2}  +  P„{T  <  m»  |sml  <  c  m2  }  . 


The  second  probability  on  the  right  hand  side  of  (18)  may  be  rewritten 


09) 


1  J_ 

Pp(m)(T  <  m}  (p(m2(iJo-M)}m2  duQ  . 


Letting  c  have  the  same  asymptotic  normalization  as  b  ,  i.e. 
-1  /2 

cm  ■  y  for  some  0  <  y  8  and  appealing  to  the  following 
theorem  gives  asymptotic  expressions  for  (19). 


-1  /2 

Theorem  2.  Assume  b  -►  «,  m  -►  •  and  b  m  -  6  >  0.  For  each 

compact  subinterval  K  of  (0,6) »  uniformly  for  p  G  K 
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pJm){T  <  m}  ~  exp{-  (B2-iiQ2  )}B  p"1  v(B2  p'1)  , 


where  v(x)  *  2  x  2  exp{-  2^n**(~yxn2)} 

1 


Corollary  1.  Suppose  m  00  and  b  m  -  B  ^  Y 


.-|/2-6>r.cm-,/2 


Then 


Pq{t  <  m,  |sm!  <  cm1^2}  ~  Bm* ^2  e  ®  m^2 <2/w) 1 ^2  /  x  *v(x)dx  . 


eV1 


-i/2  -1/2 

Corollary  2.  Suppose  m  00  and  bm  «  6  >  Y  *  cm 


Then  for  p  «f  0 


P  {T  <  m.  Is  |  <  cm,/2}  vtfV^gv"1  e“^lpl(B^Y)  , 

I P |m* ' 


Remark.  The  case  c  -  b  is  included  in  Corollary  1  but  not 


Corollary  2.  This  seemingly  innocuous  distinction  provides  con¬ 
siderable  insight  into  the  asymptotic  relation  between  the  conditio¬ 
nal  probabilities  (2)  and  the  unconditional  probabilities  P{T  m}. 
An  informal  attempt  to  elucidate  this  relation  is  given  at  the  end  of 
the  paper. 


Informal  proof  of  Theorem  2 . 


Consider  first  the  case  of  a  fixed  y  >0.  The  question  of 

o 


uniformity  will  be  considered  later.  For  >  0  it  is  easy  to  see 


that  P<m){T  <  m,  s  <  0}  ■  o(p^{T  <  m,  s  >  0})  ,  and  hence  with- 


>(m) 


o  o 

out  loss  of  generality  one  may  assume  that  T  is  defined  without  the 


absolute  value  -  as  it  is  in  Section  1 .  The  main  idea  of  the  proof  is 


1/2 


to  approximate  the  curve  0t  by  its  tangent  c  ♦  nt  at  a  suitable 


value  tQ  G  (0,1).  With  the  appropriate  value  for  the  tangent  line 


Ut  m  2(t  +  n)~U  »  the  identity  (10)  as  modified  by  (11)  becomes 

(a)  ° 

P  {T  <  m)  exp[2mt(C+n~u  ) ] 


(20) 


,  -i/2  r  r  vcra“nT  i  i  <w7  i 

•  /  O'1/®)  exp{-2(^n-P0)[  ~i-T7m  J"  2  ~~Z=T -  *dPp,  * 


(s<p“P|T)i 


{T<m} 
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r 


where  p.  ■  2(s  +  n)“lJ  •  The  point  of  tangency  t  is  chosen  so  that 

10  0  0 

Py  {T/m  -►  to>  -  I  .  (Simple  algebra  gives  t  «  (u0/6)  >  C  "  MQ/2  , 

and  n  *  8^/2pQ  . )  A  Taylor  expansion  yields 

!  I 

7T  « 

"  nT  ■  -  b  T  ♦  m{6(T/ra)  •*  5  -  nT/m} 

l 

-  sT-b  T2  -  B4(T-mo)2/8uo3m  +  o  (1)  , 

where  m  »  m  t 
o  o 


Similarly 


m  *(«T“WjT)2  »  B4(T-mo)2/4wo2  m  +  0  l  (s^-bT*  ^2)/m1^2]  +  op(l)  . 


Hence  the  integrand  in  (20)  becomes 

(.-T/«)",/2expK^B2-p2)f!l^].i 

°  °  L  1-T/m  J  l 


(l-2y2B~2)B6(T-mo)2 


(21) 


4(1 -T/m)  y  m 
o 


+  0(1)  +  0  [(s  -bT,/2)/m,/2]}  . 


1/2  1/2 

The  limiting  joint  distribution  of  -  bT  and  (T-mo)/m  may 

be  obtained  as  an  application  of  Theorem  2  of  Lai  and  Siegmund  (1977) 

or  Theorem  4.3  of  Woodroofe  (1976a).  Substituting  (21)  into  (20)  and 

integrating  with  respect  to  the  limiting  distribution  of 
1/2  1/2 

(sT-bT  ),  (Tm  )/m  ,  and  T/m  produces  the  expression  given 

in  Theorem  2. 

When  V  >2  '^8  ,  the  function  of  (T-m  )/m^  in  (21)  which 
o  o 

must  be  integrated  is  unbounded,  and  hence  some  care  is  required  to 
justify  taking  the  limit  inside  the  integral  in  the  preceding 
paragraph.  However,  straightforward  estimates  show  that 
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where  X  tends  to  +»  arbitrarily  slowly  with  m  .  By  replacing  the 
event  {T  <  m}  in  (20)  by  the  smaller  event 

{m  -  Xm*^  <  T  <  m  +  Xm*^,  s_-bT*^  <  (log  m)^}  ,  one  may  make 
O  O  I 

the  preceding  argument  precise.  The  details  have  been  omitted.  See 
Siegmund  (1978)  for  a  similar  argument  spelled  out  in  detail. 

To  see  that  the  preceding  argument  holds  uniformly  in  pro- 

vided  V  is  bounded  away  from  0  and  6  (hence  t  is  bounded 
o  o 

away  from  0  and  1)  requires  a  tedious  review  of  the  various  steps 
of  the  proof  to  see  that  each  holds  uniformly  in  .  Perhaps  the 
only  non-obvious  step  is  the  classical  renewal  theorem,  which  must  be 
applied  to  the  ladder  height  renewal  process  determined  by  the  distribu¬ 
tion  of  sT  (t+  *=  inf(n:  >  0}).  The  Fourier  analytic  proof,  given 

for  example+by  Breiman  (1968,  p.218)  seems  well  adapted  to  using 

boundedness  of  higher  moments  of  sT  to  prove  the  required  uniformity. 

♦ 

The  details  are  omitted. 

To  prove  Corollary  1,  note  that  the  theorem  immediately  implies 
for  0  <  e  <  y  <  8 

I  2  I  g2e-l 

(22)  P^{T<m,  cm  <  js^J  <  ym)  -  6m^  e  ®  /  x  *v(x)dx  . 

bV1 

Obviously,  for  0  <  6  <  l 

P  {T  < m, Is  I  <  em}  <  P  (T  <  6m) + P  (6m  <  T  <  m,|s  I  <  em} 
o  * '  m'  —  o  —  o  9 1  m1 


It  is  easy  to  see  that  for  small  6  , 

P  (T  <  6m}  <  £  P  {  [ s  |  >  bn*^}  is  small  compared  to  the  right 
°  *  ~n<6m  °  n  J/2 

hand  side  of  (22) ;  taking  e  so  small  that  66  -  e  >  o  and  using 

standard  arguments  one  sees  that  P  {6m  <  T  <  m,  Is  |  <  em)  is  also 

o  m 

small  compared  to  the  right  hand  side  of  (22).  This  proves  the 
corollary  when  y  <  6  »  and  a  similar  argument  to  estimate 
P  (T  <  m,  (l-e)8m  <  |s  |  <  6m}  handles  the  case  y  -  6  . 


The  proof  of  Corollary  2  is  almost  immediate ,  for  when  y  4  0  • 

the  entire  contribution  to  the  integral  in  (19)  comes  from  the 

“1/2 

immediate  neighborhood  of  y  -cm 
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4.  Discussion 


It  should  be  apparent  from  the  preceding  examples  that  the  method 
given  here  is  valid  for  fairly  general  random  walks  and  curved  bounda¬ 
ries.  For  example ,  it  seems  reasonably  straightforward  to  consider 
Y  ] 

curves  c(t)  ■  6t  for  0  <.  y  <_  y  and  exponential  families  as  in 
Theorem  I  to  obtain  a  simultaneous  generalization  of  Theorems  1  and  2. 
Since  the  calculations  are  messy  and  the  author  is  unaware  of  interest¬ 
ing  applications,  this  generalization  has  not  been  pursued. 

In  considering  extensions  to  more  complicated  curves  the  important 
requirement  is  that  the  appropriate  approximating  tangent  line  have 
its  point  of  tangency  t^  at  neither  0  nor  I  .  Unfortunately  these 
boundary  cases  can  arise  for  a  variety  of  reasons.  The  most  obvious 
is  that  y  may  be  a  boundary  case,  e.g.  y  *  c(l).  However,  for 

^  y  #  j  ° 

normal  random  walk  and  c(t)  «  8t '  with  y  <  Y  <  the  '‘appropriate 

tangent'1  is  at  t  «  0  for  all  y  <  c(I),  so  the  method  breaks 
o  o 

down  completely. 

Corollary  1  to  Theorem  2  with  y  *  &  yields  the  known  asymptotic 
expression  for  Pq{T  m}  by  "unconditioning"  P^{T  <  m) .  In  general 
this  is  not  an  effective  method  for  obtaining  approximations  to  the 
corresponding  unconditional  probabilities,  because  the  important  values 
of  yQ  in  the  unconditioning  integral  may  be  boundary  cases,  for  which 

the  methods  of  this  paper  fail  or  are  not  particularly  appropriate. 

1/2  ... 

For  example,  for  c(t)  *  0t  and  normal  random  walk  with  positive 

mean  y  ,  the  important  values  of  y^  in  the  unconditioning  integral 

P  {T  <  m,s  <  m6)  -  /  P^{T  <  m}<p[m2 (y  -y)  ]m2dy 

u  y  <8  yo 

o 

are  values  yQ  -  8  -  £/m  ,  for  which  the  appropriate  tangents  are 
at  tQ  ■  1 .  Hence  the  methods  of  this  paper  do  not  apply  directly, 
although  a  modification  can  be  made  to  work.  The  essential  ingredient 


* 
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is  to  consider  the  process  to  be  running  backward  in  time  from  time  m 

to  time  0.  For  the  reversed  process  the  role  of  me  is  played  by  £  , 

which  does  not  tend  to  +°°  ,  and  hence  the  subsequent  calculation  is 

almost  trivial.  And  in  fact  for  these  values  of  y  the  limiting 
/  \  o 

behavior  of  ^{T  <  m}  can  be  inferred  by  almost  trivial  arguments 
o 

(e.g.  Siegmund,  1978).  Thus,  although  the  methods  of  this  paper  give 
heuristic  insight  into  the  behavior  of  the  unconditional  probability 
P^{T  _<  m}  f  they  do  not  appear  likely  to  replace  previously  developed 
methods  for  obtaining  mathematically  rigorous  results. 
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